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ABSTRACT 

A fuzzy-neural control system simulation was developed for the control of a camera platform used to 

^e ^cture^rfi ^7!^ k “ *****' ^ fijZZy ' neural a PP roach t0 «"»»» comb.nes 

the structure of a fuzzy knowledge base with a supervised neural network's ability to adapt and improve. 

enstics of this hybrid system were compared to those of a fuzzy system and a 
an^d^ 0 J k ^ 7 deve,0 f d mdependently to determine if the fusion of these two technologies offers 
y 8 e over e use of one or the other. The results of this study indicate that the fuzzy-neural 

approach to control offers some advantages over either fuzzy or neural control alone. 


INTRODUCTION 

eI1 i ,gent ? ntr01 h , aS 56611 dramatlCally • ebaed in recent years by both fuzzy logic systems and 
artificial neural networks. Fuzzy logic controllers (FLC) provide a method for encSing knowledge of a 

(fUZ fJ CmS ne Performance of fuzzy control systems with several simple rules 
has been successfully applied to a variety of non-linear control tasks. Unfortunately, the tuning required 

r D ~ A rrr t0 a . Ch,CVe maximum performance is often a time consuming^riS-and- 
error process. Alternatively, neural networks (NN) provide a less structured, self-adaptive method for 
control where knowledge .s acquired from experience. The effectiveness of these networks however is 
m^ en i° n the , quall ^ and of fhe training data. Many researchers have recently proposed 

f ° r C ° mbl T g fiE2y log,c ^ neural networks. The fusion of these two technologielThas 

Sinter T 0f ,n * dh f nt contro1 which exploits the advantages of both technologies, allowing the 
control engineer to combine knowledge a priori with knowledge a posteriori. 

* 7 mCra ™ unted on a positioning platform can be used in aircraft guidance and recognition during 
e^rlZ anaircraft carne ; 7116 movement of suc h a platform is dependent on relative position 

6 ™h " , g6 ° , 8et ’ 38 Sh0Wn in Figure 1 The P rob ^m of controlling this platform is well- 

"S 5inCC 3 f6W Simpk Wks ^ describe the des *red characteristics of the system 
KahZl h f V6 C °7 pared ^ trackjn g 10 traditional target tracking methods suchL the 

Kalman Filter method, have shown that FLC trackers can match or surpass the performance of 
conventional tracking systems[2], ^ 01 

The success of previous research in this area inspired the idea that fuzzy target tracking could be 

8 *T ad3ptiV6 l6aming meth0d In Ms P r °J ect > an aircraft tracking camera platform 
simulation was developed using a FLC tracking system. For the sake of comparison, a simple 

backpropagation network was implemented for the same task. A fuzzy neural network (FNN) was then 
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developed using the fuzzy-neural cooperative method proposed by Kawamura et. al.[l]. This method was 
explored as a means of achieving adaptive fuzzy control by combining the structure of a fuzzy logic 
control system with the adaptive learning capabilities offered by neural networks. 



In camera tracking, the objective is to maintain a target image in the center of the camera's field-of- 
view (FOV) Typically, the exact x, y, and z location of the target is not available to the system[3]^ The 
position error must be measured in pixels as the difference between the center of the camera's FOV and 
the centroid of the target image. Likewise, range can only be determined by the relative size (number of 
pixels) of the target image. For this simulation, however, explicit position information was available 
from radar observations of several approaches. The data was sampled at 20 Hz, and the approaches 
typically lasted 45 seconds giving approximately 900 data points per approach. 

Pan and tilt are independent functions controlled by separate servos. The rates of pan and tilt are 
dependent on azimuth and elevation error, respectively, as well as range. In this simulation, a maximum 
pan rate of ± 15°/s and a maximum tilt rate of ±57s were used. In the case of carrier approaches, panning 
is a much more difficult tracking task than tilting, since more abrupt aircraft movements take place in the 
x domain than in the y domain. Therefore, only the pan functions will be described for the remainder of 
this paper, with the understanding that the tilt control system is functionally identical to the pan system. 

Fuzzy rules for camera tracking are easily derived by veibalizing the method that a person might use to 
track a moving target in photography or skeet shooting. These rules take the form of "if the target is to 
the left and it is close, then pan quickly to the left...", and so on. The FLC tracking system developed or 
this study is shown in Figure 2. It employs three membership functions for ERROR and two for RANGE. 
Six rules correspond to five output membership functions. Centroid defuzzification is used to determine 
the value of PANRATE. 


18 




ERROR 


Left 

f\ 1 

Center 1 

Al 

Right 1 

1 /I 



RANGE 


Far 

1/1 

Near 1 

r\i 



if Error is Left and Range is Far 
then Panrate is SlowPositive 

if Error is Left and Range is Near 
then Panrate is FastPositive 

if Error is Center and Range is Far 
then Panrate is Zero 

if Error is Center and Range is Near 
then Panrate is Zero 

if Error is Right and Range is Far 
then Panrate is Slownegative 

if Error is Right and Range is Near 
then Panrate is Fastnegative 
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Figure 2 - A fuzzy logic controller for aircraft tracking 

The same functions can be performed by a backpropagation network consisting of two inputs, one 
output, and one hidden layer as shown in Figure 3. 



Figure 3 - A simple backpropagation network for aircraft tracking 


3. FNN TRACKING SYSTEM 


The development of a FNN tracking system required that a network be created which modeled the 
behavior of the fuzzy tracking system. In this way, the essential operations of fuzzification, inferencing, 
and defuzzification are accomplished through a series of functions represented by selectively connected 
nodes. The network architecture and initial system parameters must be empirically developed so that the 
FNN matches the functions of the existing FLC. 

Input membership functions are easily realized through the use of the sigmoidal functions associated 
with neurons: 


S(V ')*T77 W (1) 

where EwjjOj is the sum of the input-weight products and 0 is the bias or threshold. As Figure 4 shows, 
the input functions for ERROR and RANGE are represented as logistic sigmoids for Left, Right, Near, 
and Far and as the difference between two sigmoids in the case of the bell-shaped Center function. The 
appropriate weight and threshold values were determined, and the antecedent membership functions take 
the following form: 


19 


















LEFT = 


CENTER = 


1 

j +e 13.3£RROR-13 
1 


(2a) 


1 


RIGHT =- 


j + ^3.3£WKK +3.3 j + +9.9 

1 


(2b) 


1 + e 


-J3 3SWOR-9.9 


(2c) 


E4i? = 


1 


jVE4i? = 


j + e Al lRANGB -6.6 
1 


l+£ 


,13 GRANGE -6.6 


(2d) 

(2c) 


Left C#nt»t Right 

Q23 

Near Far 


FLC 

Figure 4 - Antecedent membership functions as sigmoids Figure 5 - Consequent membership functions as singletons 

The inference process correlates input membership values to output membership values. All rules in 
this system are conjunctive, meaning that they feature the AND operation. Using max-product 
inferencing, the result of the AND operation is simply the product of the inputs. Alternatively, max-min 
inferencing could be used, where the conjunctive inference nodes would use the min(A,B) operator. 

Output (consequent) membership functions are represented as singleton functions for the purpose of 
simplifying the defuzzification process. Singleton functions have only one value. In this case they 
represent the approximate centroid of the original output membership functions, as shown in Figure 5. 

By assigning the singleton values to weights at the output layer, defiizzified values can be computed as a 
weighted average of these singletons based on the truth value of the consequent membership . 

OUTPUT = (3) 




The resulting network takes the form shown in Figure 6. Hidden layers represent input, rules, and 
output functions. When ERROR and RANGE values, normalized to (0,1 J, are fed forward into the 
network, they are is converted to membership values. These membership values are then processed by 
rule nodes, yielding output (consequent) membership values. These membership values are then 
defiizzified as explained previously. To this point, the behavior of the FNN is identical to that of the FLC. 
Parametric learning is then accomplished via the generalized delta rule, as in many other backpropagation 
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networks. [4] The system error is simply the difference between the new center of the camera’s field-of- 
view and the actual aircraft position. Adjustments are made to weights at the input and output layers 
based on the calculated deltas derived from the system error, according to the relation: 

A w jk = »1 8 k Oj (4) 


Inpi^MernbertNp Ruto/tnforondng Output Membership 



/ ' ' J i j 

Figure 6 - A fuzzy neural network for aircraft tracking 


SIMULATION RESULTS 

Using *“*? from s ^ veral different carrier approaches, the FLC, NN, and FNN tracking methods were 
implemented in simulation. Figure 7 is a comparison of the performance of each system on a section of 
tte test approach after one, fifteen, and fifty approaches. The dotted lines represent the aircraft movement 
about the centerline of the approach path, and the solid lines represent the line of sight of the camera. 

aircraft’^r^titinn 06 c° f the , f ? C WaS g00d ’ but the camera ’ s iine-of-sight lagged slightly behind the 
aircrafts postilion. Since it has no parametric adjustment capability, its performance obviously did not 

improve with time. As was expected, the NN tracker began with random behavior on the first approach 
By the end of the first approach, the network began to learn the basics of panning and tilting but left 
for ' m Provement. The performance had improved substantially by the fifteenth approach 

thp fiftJih lagg ^ shghU y and tended t0 overshoot the aircraft during motion reversals. By 

e fiftieth approach, the lag had diminished to near-zero, but some overshoot was still evident. 

T the / irS u ap P roach sh °wed improvement over the FLC, demonstrating much less lag 
SifirS ° V h T 5 th ' fif l eenth ap P roach > lag was nearly eliminated and the overshoot was 
ind^tml U h r w U r t** ‘ he fiftieth approach, the line-of-sight of the FNN tracker was virtually 
indistinguishable from the path of the aircraft. Since it began with the intrinsic knowledge of the FLC 

methods*" 8 ° Utpa<Xd ° f the ^ tracker Under a11 conditions, the FNN outperformed the other two 
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CONCLUSIONS 


A fuzzy-neural network was successfully implemented for automatic camera platform positioning, 
eliminating the need to manually adjust FLC parameters for optimum performance. The simulations 
conducted in this study demonstrated that when structured knowledge and learning ability are combined, 
the result is robust performance that improves over time. The fusion of these two types of machine 
intelligence represents an important step in the evolution of intelligent control systems. 

The FNN may be applied to a wide range of non-linear control systems, particularly where fuzzy 
control has already proven successful. In any system whose desired behavior can be described through a 
series of fuzzy rules, those rules can be translated into a network and thereby achieve the ability to adapt. 
The learning algorithm does not add an excessive amount of computation to an existing FLC, and thus it 
should be feasible for real-time applications where the system can learn "on the fly". Such experiments 
are planned for this system in upcoming research 
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ABSTRACT 

Artificial neural systems (ANS), also known as neural networks, are an attempt to develop computer 
systems that emulate the neural reasoning behavior of biological neural systems (e.g. the human brain). As such, 
they are loosely based on biological neural networks. The ANS consists of a series of nodes (neurons) and 
weighted connections (axons) that, when presented with a specific input pattern, can associate specific output 
patterns. It is essentially a highly complex, non-linear, mathematical relationship or transform. These constructs 
have two significant properties that have proven useful to the authors in signal processing and process modeling: 
noise tolerance and complex pattern recognition. Specifically, die authors have developed a new network learning 
algorithm that has resulted in the successful application of ANS's to high speed signal processing and to 
developing models of highly complex processes. Two of the applications, the Weld Bead Geometry Control 
System, and Welding Penetration Monitoring System is discussed in the body of this paper. 

INTRODUCTION: ARTIFICIAL NEURAL SYSTEMS 

Artificial Neural Systems (ANS) are loosely based on biological neural networks offer a computer 
technology that is a useful tool in process modeling and signal processing. The ANS consists of a series of nodes 
(neurons) and weighted connections (axons). As with a biological neural network, the assignment of the values of 
the weights and the size and configuration of the network is the key to a successful net. Unfortunately, we have 
only begun to understand the inner workings of these constructs. Consequently, relatively crude tools are 
currentiy employed to develop working networks. 

Typically, the approach to model development is to develop a thorough understanding of the underlying 
basic scientific or engineering principles of the process. Then, a model is developed that is based on 
mathematical relationships inherent in the process parameters. The principal drawback with this approach is the 
time and effort required to develop an understanding of these basic scientific or engineering relationships. 
Depending on the complexity of the problem, it can take many years and an extensive research program to 
develop the relationships. Often, instead, a number of simplifying assumptions are made and an approximate 
model is developed. That approach, while being an expedient method for developing an approximate model that 
could be useful, provides only a theoretical approximation that may not be valid for the actual problem 
application. 

The artificial neural system, when a network can be found to solve the problem, provides an accurate 
model of the process or signal. Neural networks are empirical bases systems that, when presented with a specific 
input pattern, can associate specific output patterns. It is, essentially, a highly complex, non-linear, mathematical 
relationship or transform. However; it is not necessary for the developer of such a system to understand the basic 
underlying principles of a process in order to develop a highly accurate ANS based model of the process. Thus, in 
this way it is quite different from other mathematical modeling approaches. 

Basic Principles 
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